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ABSTRACT 

This  study  describes  an  experiment  designed  to  investigate 
potential  advantages  and/or  disadvantages  of  color-coding 
relative  to  symbol-  or  alphanumeric-codes.   Performance  was 
evaluated  in  terms  of  reaction  time  and  the  number  and  type 
of  errors  made. 

The  stimuli  used  in  the  experiment  were  the  letters:   E,  F, 
N,  U,  the  colors:   red,  yellow,  green,  blue,  and  the  symbols: 
square,  triangle,  circle,  and  cross.   They  stood  for  enemy, 
friendly,  neutral,  and  unknown  forces,  respectively. 

The  analysis  of  the  data  obtained  from  the  experiment 
suggested  that  the  color-  and  symbol-codes  were  significantly 
better  than  the  alphanumeric-code  with  respect  to  the  number 
of  errors.   The  reaction  time  of  the  color-code  was  shortest, 
followed  by  the  symbol-code  with  reaction  time  for  the 
alphanumerics  being  longest. 
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I.   INTRODUCTION 

There  are  many  stimuli  that  people  sense  directly  (e.g., 
color,  sound) .   However,  there  are  many  situations  and 
environments  (e.g.,  stimuli  below  threshold  values  or  stimuli 
to  which  people  are  not  responsive  as  X-ray  radiation)  in 
which  information  that  people  need  in  performing  some 
activity  must  be  presented  by  the  use  of  a  display.   A 
display,  in  general,  is  any  device  or  medium  that  is  used 
to  convey  information  to  an  operator.   Displays  can  be 
either  dynamic  or  static. 

Dynamic  displays  are  those  that  change  through  time, 
e.g.,  speedometer,  television,  or  radar  displays,  while  static 
displays  remain  fixed  over  time  such  as  charts.   Another 
feature  of  a  display  is  whether  it  is  formatted,  unformatted, 
or  whether  it  has  a  variable  format. 

Formatted  displays  have  a  fixed  format  such  as  specified 
scales  or  intervals  like  a  thermometer.  On  unformatted  dis- 
plays, random  stimuli  are  presented.  A  display  with  variable 
format  is  a  combination  of  the  other  two.  An  Air  Control 
Radar  display,  for  example,  has  a  variable  format  with  fixed 
stimuli  for  the  contours  of  landmarks  and  runways  and  random 
stimuli  for  incoming  aircraft. 

A  variety  of  information  can  be  presented  by  displays. 
The  information  can  be: 

1.  quantitative  as  temperature  or  speed, 

2.  qualitative  by  indicating  a  change  of  a  variable 
or  parameter, 

10 


3.  status  indication  such  as  on-o££, 

4.  signal  indicating  an  unsafe  condition, 

5.  presentational  information  such  as  blips  on  a 
cathode  ray  tube  (CRT) , 

6.  identification  information  used  to  identify  a  static 
condition,  situation  or  object. 

7.  alphanumeric  or  symbolic  information  such  as 
musical  notes,  computer  printouts,  or 

8.  time-phased  information  such  as  Morse  code. 

This  study  is  concerned  with  dynamic,  unformatted  dis- 
plays with  symbolic  information  such  as  might  be  used  on  CRTs 
for  military  purposes.   Since  World  War  II,  these  display 
types  (e.g.,  radar,  sonar)  have  been  widely  used  and,  as  the 
weapon  systems  are  getting  more  sophisticated,  more  informa- 
tion has  to  be  displayed.   In  connection  with  external  sensors, 
the  computer  aided  displays  not  only  present  the  blip  of 
a  radar  contact;  they  provide  additional  information  mostly 
in  the  form  of  alphanumeric  codes  such  as  classification, 
track-number,  speed,  altitude,  etc. 

Performing  an  activity  with  these  displays  requires  an 
experienced  operator  to  read  the  complex  displays  and  to 
distinguish  between  relevant  and  irrelevant  information/noise. 
Simultaneous  to  this  increased  complexity  has  been  an  increase 
in  the  workload  of  the  operator  in  modern  military  systems. 
For  example,  the  pilot  of  a  single-manned  fighter  airplane 
is  not  only  the  pilot  of  a  high-speed  aircraft  in  the  conven- 
tional sense;  he  is  also  a  navigator,  a  tactical  coordinator, 
a  communications  officer,  and  a  weapon  officer  with  responsi- 
bility for  his  expensive  system  and  control  of  his  weapons 

(nuclear  warheads) . 
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To  improve  efficiency,  various  methods  of  coding  the 
increasingly  complex  information  have  been  attempted.   For 
example,  in  manual  and  computer-driven  plotting  systems, 
colored  symbols  (e.g.,  blue  for  own  forces  and  red  for  hostile 
forces)  may  be  used  to  make  it  easier  for  the  operator  to 
interpret  the  situation,  and  to  reduce  the  reaction  time  to 
displayed  information. 

Today's  state-of-the-art  in  electronic  engineering 
suggests  the  possibility  of  using  color-codes  on  tactical 
displays  as  well  as  in  manual  plotting  systems.   However, 
this  coding  technique  is  far  more  expensive  than  the 
monochromatic  ones,  and  it  has  to  be  examined  to  determine 
whether  the  color-code  technique  does  really  have  an  advantage 
over  less  expensive  coding  techniques  such  as  alphanumeric- 
or  symbol-code. 

Therefore,  the  experiment  as  reported  here  will  test  the 
three  coding  modalities  to  find  out  whether  the  color-code  is 
superior  to  the  other  codes  with  respect  to  reaction  time  and 
to  the  number  of  errors  made. 
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II.   LITERATURE  REVIEW 

A.   COLOR  CODE  AND  PERFORMANCE 

Considerable  research  has  been  performed  on  the  applica- 
tion of  color  as  a  coding  modality.   For  example,  studies 
by  Hitt  (1961),  Christner  and  Ray  (1961),  Cook  (1974), 
Christ  (1975),  Wagner  (1977),  Teichner  et  al.  (1977)  have  all 
examined  color-aided  displays.   However,  no  definite  conclu- 
sion is  available  that  suggests  color  has  an  advantage  over 
other  coding  modalities. 

Specially,  the  literature  dealing  with  color  coding  and 
performance  does  not  lead  to  a  specific  conclusion  relating 
increment  or  decrement  in  performance  as  a  result  of  using 
color  coding.   Burdick  et  al .  (1965)  reviewed  both  the  litera- 
ture on  color  coding  and  the  state-of-the-art  for  CRTs  and 
emphasized  a  cost-effectiveness  approach.   They  concluded  that 
color  CRTs  were  probably  worth  the  additional  cost  for  some 
tasks,  such  as  search  tasks,  at  the  time  of  their  writing. 
Oda  (1977)  summarized  an  experiment  of  a  color-coded,  computer 
aided  multipurpose  display  (MPD)  for  the  TACCO  of  an  S-3A 
Viking  and  found  that  the  color-coded  MPD  tended  to  improve 
the  functional  effectiveness  of  TACCOs  with  low  experience 
levels.   This,  of  course,  does  not  answer  the  total  question 
about  benefits  of  colored  CRTs. 

On  the  other  hand,  Teichner  et  al .  (1977)  concluded  that 
color-coding  is  of  little  benefit  with  regard  to  performance 
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and  Christ  and  Corso  (1975)  indicated,  after  performing  a 
series  of  experiments  with  colors,  letters,  digits,  and 
symbols,  that  performance  with  color  was  not  superior  to 
the  other  codes. 

B.   USE  OF  COLORS  IN  CERTAIN  TASKS  AND  SITUATIONS 

Smith  (1978)  summarized  the  existing  literature  and 
related  the  best  coding  methods  to  certain  tasks.  This 
summary  is  given  in  Table  I. 

Table  I 
Task  and  Recommended  Coding  Methods 


1st  Coding 

2nd  Coding 

Task 

Function 

Method 

Method 

Search 

Where  is  it? 

Color 

Number  or 
Letter 

Identify 

What  is  it? 

Number 

Letter 

Count 

How  many? 

Number 

Color 

Compare 

Yes/No 

Number 

Color 

Verify 

True/False 

Number 

Color 

Krebs  et  al.  (1978)  have  suggested  that  color  may  be  of 
benefit  in  the  following  situations: 

1.  The  display  is  unformatted. 

2.  The  symbol  density  is  high. 

3.  The  operator  must  search  for  relevant  information. 
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4.  The  color  code  is  logically  related  to  operator's 
task. 

5.  The  symbol  legibility  is  degraded. 

In  addition  to  these  criteria.  Smith  (1978)  suggested 
that  color  may  be  of  benefit  as  a  coding  modality  if  the 
target  position  is  unknown,  but  the  color  of  the  target  is 
known.   This  restricts  the  use  of  colors  to  certain  types  of 
situations  such  as  in  search  tasks. 

C.   LIMITATION  OF  THE  NUMBER  OF  COLORS 

A  major  shortcoming  of  color  is  the  number  of  dimensions 
that  can  be  coded  when  color  is  the  selected  coding  modality. 
The  number  of  dimensions  that  can  be  coded  is  limited  to  four 
This  is  a  common  finding  of  color  researchers.   Hanes  and 
Rhoades  (1959),  Ruch  (1966),  Krebs  et  al.  (1978),  and 
Wagner  (1977)  stated  that  up  to  about  50  colors  may  be 
identified  with  extensive  training,  but  in  the  applied  sense, 
they  agreed  that  if  identification  is  required,  the  number 
of  colors  should  not  exceed  four. 

Krebs  et  al.  (1978)  summarized  the  criteria  for  selecting 
a  specific  color  set: 

1.  Maximize  wavelength  separation. 

2.  High  color  contrast. 

3.  High  visibility  in  specific  application. 

4.  Compatibility  of  the  use  with  conventional  meanings. 

5.  Legibility  and  ease  of  reading. 

6.  Highly  saturated  colors  preferable. 
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D.   COLORS  AND  THEIR  CONVENTIONAL  MEANING 

Some  colors  have  a  conventional  meaning.   For  example, 
red  means  danger  or  stop.   Smith  (1978)  listed  some  colors 
in  relation  to  their  conventional  meanings  and  to  the 
operators'  reactions,   (See  Table  II.) 

Table  II 
Colors  and  their  Conventional  Meanings 


Color 

Meaning 

Operators'  Reaction 

Flash  Red 

Emergency 

Immediate  action  required. 

Red 

Alert 

Corrective  action  must  be 
taken. 

Yellow 

Advice 

Caution,  recheck  necessary. 

Green 

Proceed 

Condition  OK. 

White 

Transitory 
Function 

No  wrong  or  right  indication. 

Blue 

Advisory 

Should  be  avoided. 

E.   LUMINANCE,  BRIGHTNESS,  CONTRAST,  SATURATION 

Other  factors  that  influence  performance  in  using 

colored  displays  include: 
1.   Luminance 

That  is  the  amount  of  light  emitted  from  a  display 

surface  (luminous  intensity)  as  viewed  by  the  observer.   The 

subjective  measure  of  luminance  is  brightness. 
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2.  Brightness 

Brightness  refers  to  a  subjective  impression  of 
relative  luminance.   That  is,  a  symbol  of  fixed  luminance 
will  appear  brighter  on  a  dark  background  than  on  a  light 
background.   Thus,  brightness  judgments  are  at  least  in 
part  influenced  by  contrast. 

3 .  Contrast 

Contrast  is  a  measure  of  the  relationship  between 
the  luminance  of  a  symbol  and  its  background. 

4.  Saturation 

The  colors  themselves  are  of  different  purity.   For 
example,  the  two  colors  pink  and  red  have  nearly  the  same 
hue;  that  is  the  attribute  of  a  color  to  which  commonly  used 
labels  such  as  green  are  assigned,  but  red  would  be  much 
more  saturated  than  pink.   Black,  white,  and  gray  have  a 
saturation  value  of  zero.   Judd  and  Wyszecki  (1952),  cited 
in  Haber  and  Herschenson  (1973)  ,  utilized  Figure  1  to 
explain  color  saturation.   Saturation  is  the  relative 
purity  of  a  color  defined  in  terms  of  its  departure  from 
a  white  or  gray  of  the  same  lightness. 

F.   SYMBOL  SIZE 

For  optimal  perception  of  color,  not  only  is  color  satura 
tion  of  importance  but  also  the  size  of  the  colored  targets. 
Krebs  et  al .  (1978)  recommended  sizes  from  21  to  45  minutes 
of  an  arc  (in  terms  of  visual  angle)  depending  on  the  number 
of  colors  used  in  the  code  (see  Figure  2) ,  and  they  stated 
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LIGHT 


GRAY 


BLUE 


YELLOW 


DARK 
(black) 


Note:   The  four  hues  shown  are  o£ 
the  same  saturation  value. 


Figure  1.   Color  Saturation 
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Symbol 
Size 

(Minutes 
of  Arc) 


2     3     4      5     6 


Number  of  Colors  Discriminable 


Figure  2.   Symbol  Size  versus  Number  of  Colors 
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that  color  perception  may  be  adversely  affected  if  the  symbol 
size  is  below  21  minutes  of  an  arc. 

If  luminance  contrast,  however,  is  low,  or  the  display 
readability  is  degraded  by  noise  and/or  poor  resolution, 
the  symbol  size  should  be  increased  beyond  the  minimum 
recommended  levels. 

All  these  factors  --  number  of  colors,  size,  tasks, 
situations,  conventional  meaning,  luminance,  brightness, 
contrast,  and  saturation  --  are  important  not  only  by 
themselves  but  also  in  all  their  possible  combinations  and 
interactions  in  discussing  and  evaluating  performance  with 
color-coded  displays. 
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III.   EXPERIMENT 

The  objective  of  this  experiment  was  to  test  the  Null 
hypothesis  that  there  is  no  difference  between  the  three 
coding  modalities,  colors,  symbols,  and  alphanumerics ,  with 
respect  to  human  performance  measured  as  reaction  time  and  the 
number  of  errors.   The  alternative  was  that  one  coding  tech- 
nique is  superior  to  the  other  codes. 

A.   EXPERIMENTAL  DESIGN 

1 .   General  Description 

In  most  modern  military  systems,  operators  are 
expected  to  perform  simultaneously  multiple  tasks  such  as 
flying  an  aircraft  or  navigating  in  addition  to  monitoring 
a  tactical  display  and  making  decisions  based  on  the  informa- 
tion provided.   Kopala  (1979)  performed  a  simulation  experi- 
ment with  pilots.   Pilots  simultaneously  performed  routine 
flying  tasks,  while  monitoring  the  display,  but  she  compared 
symbols  with  the  redundant  colored  symbol  code.   The  task 
selected  for  this  experiment,  however,  involved  only  a  search 
task  and  a  choice  reaction  task  (identification) .   As  in  case 
of  a  CRT  for  a  pilot,  we  have  an  unformatted  display  with 
moderate  to  high  contact  density;  further  the  pilot  has  to 
search  the  display  for  relevant  information. 

The  experiment  itself  was  divided  into  three  sub- 
experiments.  The  subjects  were  shown  decks  of  cards  with 
either  symbols,  colors,  and  alphanumerics.   Within  each 
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deck  of  cards  were  five  "target  cards."  Target  cards  were 
those  cards  that  presented  a  specific  letter,  symbol,  or 
colored  dot,  which  were  known  in  advance  by  subjects. 
Targets  in  this  context  could  mean  anything  to  the  subjects, 
e.g.,  an  attacking  missile,  a  hostile  fighter,  or  something 
specified  in  their  missions. 
2 .   Stimuli  Presented 

Since  the  recommended  number  of  colors  is  four, 
only  four  symbols,  colors,  and  alphanumerics  were  used. 
This  variable  was  held  constant  to  obtain  the  same  number 
of  dimensions  in  the  three  sub-experiments. 

The  human  eye  is  limited  to  a  visible  spectrum 
of  electromagnetic  radiation  with  wavelength  from  380 
nanometers  (violet)  to  750  nanometers  (red) .   Out  of  this 
spectrum,  the  following  four  colors  were  chosen  for  the 
experiment:   blue,  green,  yellow,  red. 

These  colors  were  selected  not  only  because  of  their 
high  wavelength  separation;  they  were  also  logically  related 
to  the  task  of  the  operator  and  are  compatible  to  conventional 
meanings.   Further,  these  colors  are  well  saturated  and  no 
confusion  has  been  reported  by  subjects.   The  diameter  of  the 
colored  dots  was  3.1  millimeters.   This  corresponds  to  about 
35  minutes  of  an  arc  at  a  viewing  distance  of  30  centimeters, 
which  is  more  than  the  minimum  size  of  31  minutes  of  an  arc 
suggested  by  Krebs  et  al.  (1978). 

The  colors,  alphanumerics,  and  symbols  selected  for 
the  experiment  are  shown  in  Table  III  together  with  their 

possible  meaning. 
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Table  III 
Stimuli  for  the  Experiment  and  their  Meaning 


Color 

Symbol 

Alphan 

Possible  Meaning 

Red  Dot 

A 

E 

Enemy,  Danger 

Yellow  Dot 

D 

U 

Unknown,  Unidentified, 
Attention 

Green  Dot 

+ 

F 

Friendly,  No  Danger 

Blue  Dot 

0 

N 

Neutral,  No  Danger 

The  alphanumerics  and  the  symbols  were  of  the  same 
size  as  the  colored  dots  with  a  stroke  thickness  to  height., 
of  about  1:6  and  in  case  of  the  letters  with  a  width-height 
ratio  of  3:5  as  recommended  in  McCormick  (1976).   The  symbols 
are  commonly  known  and  easy  to  discriminate.   Some  of  the 
symbols  are  used  in  existing  codes,  for  example,  on  German 
Fast  Patrol  Boats. 

The  four  letters  were  chosen  because  they  are  the 
first  letters  of  the  word  and  could  serve  as  abbreviations : 

F  -  Friendly 

U  -  Unknown 

E  -  Enemy 

N  -  Neutral. 
Target  cards  were  those  cards  with  a  red  dot,  a 
triangle,  or  an  E.   There  were  10  stimuli  on  each  12  x  8.5- 
centimeter  card.   A  deck  of  cards  consisted  of  40  cards  with 
either  alphanumerics,  colors,  or  symbols.   The  five  target 
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cards  were  randomly  distributed  within  the  decks  using  the 
Uniform  Random  Number  generator  of  the  hand-held  calculator 
TI59  (Statistics  Module,  Program  02).   The  positions  of  the 
target  cards  within  each  deck  were  changed  for  each  subject. 

Superimposed  on  the  120  cards  was  a  single  card  with 
colors,  alphanumerics ,  and  symbols  not  used  on  the  other 
cards.   This  card  represented  noise  or  disturbances.   It 
should  make  the  task  more  realistic  because  noise  is  also 
found  on  radar  scopes  and  other  displays.   A  single  noise 
card  was  used  throughout  the  experiment  to  hold  this  variable 
constant  and  to  prevent  the  possibility  that  several  noise 
cards  influenced  performance  differences.   For  the  same 
reason,  the  number  of  stimuli  presented  per  trial  (density) 
was  the  same;  there  were  20  stimuli  on  the  noise  card  in 
addition  to  the  10  stimuli  per  signal  card. 

No  attempt  was  made  to  control  the  position  of  the 
stimuli  on  the  card.   All  stimuli  were  put  on  the  card  in 
a  random  fashion;  superposition  was  avoided. 
3.   Procedure  and  Outcomes  Measured 

A  random  number  generated  from  the  discrete  Uniform 
Distribution  between  one  and  six  (TI59  Statistics  Module, 
PGM  02)  determined  in  which  sequence  the  three  decks  of  cards 
(one  deck  for  each  code)  were  presented.   The  possible  out- 
comes and  the  resulting  sequences  are  listed  in  Table  IV. 

Within  the  three  decks  of  cards ,  each  card  was 
presented  to  the  subjects  for  1.5  seconds.   During  this 
time,  they  had  to  search  the  card  and  determine  whether  or 
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Table  IV 
Sequence  of  Code  Presentation 


Random 

Number 

Sequence 

1 

alphan.  -  colors  - 

symbols 

2 

alphan.  -  symbols 

-  colors 

3 

colors  -  alphan.  - 

symbols 

4 

colors  -  symbols  - 

alphan. 

5 

symbols  -  alphan. 

-  colors 

6 

symbols  -  colors  - 

alphan. 

not  it  was  a  target  card.   Subjects  were  required  to  identify 
the  red  dot,  the  triangle,  or  the  E,  respectively,  and  to 
respond  to  the  target  cards  by  pressing  a  button.   The  out- 
comes measured  were: 

1.  Reaction  time.   That  is  the  time  from  first  showing 

the  target  card  until  the  subject 
responded.   The  reaction  time  in- 
cluded information  processing  (de- 
cision) ,  a  central  response,  and  the 
movement  time. 

2.  Number  of  errors  of  omission.   These  are  those  errors 

that  occurred  where  the  subject  missed 
a  target  card  or  responded  too  late 
(after  presentation  of  the  card) . 

3.  Number  of  errors  of  commission.   These  are  the  errors 

that  occurred  where  the  subject  re- 
sponded to  a  non-target  card  (False 
Alarm) . 

The  subjects  did  not  know  how  many  target  cards 

were  within  the  decks  of  cards.   They  were  informed  that 
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the  probability  of  viewing  a  target  card  was  much  lower  than 
0.5.   (See  Instructions,  attached  as  Appendix  A.) 

Prior  to  the  experiments  with  the  three  decks  of  40 
cards,  three  "warm-up  runs"  had  to  be  completed  by  the  sub- 
jects. In  these  runs,  10  cards  of  each  code  were  presented 
to  the  subjects.  The  probability  of  viewing  a  target  card 
here  was  0,5  (every  other  card).  These  trials  familiarized 
the  subjects  with  the  stimuli  equipment  and  ascertained 
that  the  instructions  were  understood. 

Between  each  sub-experiment,  breaks  of  two  minutes 
were  given  to  the  subjects  to  avoid  possible  fatigue  effects 
and  to  set  up  the  next  sub -experiment .   Smoking  was  not 
allowed  while  performing  the  experiment  to  avoid  possible 
performance  degradation  due  to  reduced  oxygen. 

B.   APPARATUS 

The  stimulus  presentation  apparatus  used  was  a 
Tachistoscope  G1130  Model  T-3A  manufactured  by  Ralph 
Gerbrands  Company.   It  consisted  of: 

1)  3-Field  Exposure  Cabinet 

2)  6-Channel  Digital  Timer 

3)  3-Field  Lamp  Driver 

4)  Logic  Interface  (G1159)  and 

5)  Automatic  Card  Changer  (G1150) . 

The  physical  set-up  of  the  equipment  is  shown  in  Figures  3  and 
4.   The  tachistoscope  is  an  instrument  for  providing  very 


26 


From  top  to  bottom: 

Logic  Interface 

Lamp  Driver 

Automatic  Card  Changer 

Timer 

Exposure  Cabinet  with  Viewing  Field 

Response  Button 


Figure  3.   Tachistoscopic  Equipment 
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Digital  Lab  8/E  Computer  with  Terminal 
and  Logic  Interface  between  Card  Changer 
and  Response  Button  and  Computer. 


Figure  4.   Computer,  Terminal,  Interface 
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brief  timed  exposure  o£  visual  material  as  images,  letters, 
or  digits.   It  is  a  tool  in  learning,  attention,  and  per- 
ception studies. 

The  exposure  cabinet  had  three  viewing  fields  into  which 
visual  material  could  be  placed.   These  materials  are  shown 
to  the  subjects  via  a  system  of  mirrors.   Superposition  is 
possible.   Two  of  the  viewing  fields  are  semi-automatic; 
that  is,  the  cards  have  to  be  placed  in  the  field  manually. 
The  third  field  is  connected  to  the  Automatic  Card  Changer 
in  which  up  to  100  cards  can  be  preloaded. 

The  Digital  Timer  normally  times  the  Automatic  Card 
Changer  and  the  Lamp  Driver.   The  Lamp  Driver  supplies  drive 
current  to  the  lamps  in  the  Exposure  Cabinet.   The  Logic 
Interface  is  placed  in  series  between  the  Timer  and  the  Lamp 
Driver.   By  using  controls,  it  is  possible  to  operate  any 
of  the  three  viewing  fields  of  the  Tachistoscope  with  any 
of  the  six  channels  of  the  Timer. 

For  this  experiment,  a  Digital  Equipment  Corporation 
Lab  8/E  computer  was  used  to  record  the  responses.   The  com- 
puter was  connected  to  the  Card  Changer  and  the  response 
button  (Figures  3  and  4) .   The  response  button  was  placed 
under  the  viewing  hood  in  front  of  the  subject. 

A  Basic  (computer  language)  Program,  provided  by  the 
Human  Factors  Laboratory  of  the  Naval  Postgraduate  School, 
was  used  to  time  the  Automatic  Card  Changer,  to  count  the 
errors  of  commission  and  omission,  and  to  measure  the 
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reaction  time  to  the  one -hundredth  of  a  second.   The  Basic 
Program  is  attached  as  Appendix  B. 

The  noise  card  was  placed  in  one  of  the  semi-automatic 
viewing  fields  and  superimposed  on  the  decks  of  10  cards 
of  the  "warm-up  runs,"  and  the  decks  of  40  cards  of  the 
"hot  runs,"  respectively. 

Except  for  the  computer,  the  terminal,  and  the  Interface, 
the  equipment  was  placed  in  an  "Industrial  Acoustic  Co.,  Inc. 
Control  Acoustic  Environmental  Chamber"  to  minimize  distrac- 
tion of  subjects  while  performing  the  experiment  and  to  have 
the  same  environmental  conditions  for  all  subjects. 

C.   SUBJECTS 

Twenty-three  students  and  one  member  of  the  faculty  of 
the  Naval  Postgraduate  School  volunteered  as  subjects  for 
this  experiment.   All  24  subjects  were  military  officers. 
They  were  from  six  different  countries,  USA  (11),  Germany  (9), 
Canada  (1) ,  India  (1) ,  Israel  (1)  ,  and  Korea  (1) .   Twenty 
subjects  were  from  the  Operations  Research  Department,  four 
from  other  departments  of  the  Naval  Postgraduate  School.   All 
were  of  age  between  27  and  39.   Subjects  were  asked  before 
performing  the  experiment  about  color  defects;  none  were 
reported.   As  the  subjects  were  officers,  they  had  been 
military  screened  and  corrected  to  20/20  vision. 
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IV.   ANALYSIS  AND  RESULTS 

A.   ERRORS 

The  percentage  of  errors  made  by  the  24  subjects  under 
the  three  codes  are  given  in  Tables  VI  and  VII  of  Appendix  C 

Table  VI  shows  the  percentage  of  errors  due  to  errors 
of  omission,  Table  VII  the  percentage  of  errors  due  to 
errors  of  commission. 

The  nonparametric  test  "Friedman  Two-Way  Analysis  of 
Variance  by  Ranks"  (Siegel,  1956,  p.  166}  was  conducted 
to  test  the  Null  hypothesis, 

Hg  :  the  three  coding  techniques  have  no  differential 

effects  on  the  number  of  errors  of  omission/commis- 
sion, 

against  the  alternative, 


H^  :  the  three  coding  techniques  have  differential  effects 
on  the  number  of  errors  of  omission/commission. 


The  teststatistic  for  this  test  is  computed  by  the  formula 


'^r '  m^rW  J/^)'  -  '""^^^'^  • 


where  N  is  the  number  of  subjects, 
k  the  number  of  codes ,  and 
R-  the  ranksum  of  code  j  (column  ranksum) . 

For  large  N  (>_  10)  the  test  statistic  is  approximately  CHI 
SQUARE  distributed  with  k-1  degrees  of  freedom  (df ) . 
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An  a-level  of  0.05  was  used  throughout  all  Hypothesis 
tests. 

1.  Errors  of  Omission 

In  case  of  the  errors  of  omission,  the  following  data 
were  used  to  calculate  the  test  statistics: 
a   =  0.05  ,  k  =  3  ,  R,  (alphan.)  =  62.5, 
N  =  24   ,  df  =  3  ,  R^  (colors)   =  39.5,  and 

R   (symbols)  =  42.5  . 

This  resulted  in  a  value  for  the  chi  square  test 

2 
statistic  of  X   =  13.27.   The  corresponding  probability 

obtained  from  a  chi  square  table  (Siegel,  1956)  is  approxi- 
mately 0.001.   As  p  -  0.001  is  less  than  a  =  0.05,  Hq  is 
rejected. 

Although  there  is  no  range  test  available  to  indi- 
cate where  the  differences  are,  it  seems  to  be  obvious  that 
the  alphanumeric  code  differs  from  the  other  two  codes 
because  R,  was  much  larger  than  R^  and  R   while  R-  and  R, 
were  quite  similar. 

2.  Errors  of  Commission 

For  evaluation  of  the  errors  of  commission,  the  follow- 
ing data  were  computed  to  calculate  the  test  statistic: 
a  =  0.05  ,  k  =  3,  R,  (alphan.)  =  59, 
N  =  24   ,  df  =  2,  R^  (colors)   =  43.5,  and 

R   (symbols)  =  41.5  . 

2 
Here  the  test  statistic  was  X   =  7.65  with  an  asso- 

r 

ciated  probability  of  p  ~  0.02,  and  as  p  was  less  than  a. 
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the  Null  hypothesis  was  rejected.   For  the  same  reason  as 
above,  a  difference  of  the  alphanumeric  code  versus  the  other 
two  codes  is  concluded. 

B.   REACTION  TIME 

The  observed  reaction  times  are  listed  in  Appendix  E, 
Table  IX.   First,  the  mean  reaction  times  of  the  subjects  under 
the  three  coding  techniques  were  analyzed  by  the  "Friedman 
Two-Way  Analysis  of  Variance  by  Ranks"  to  test  the  Null 
hypothesis , 

Hq  :  the  three  coding  techniques  have  no  effect  on  the 
mean  reaction  time  of  the  subjects, 

against  the  alternative, 

H,  :  the  three  coding  techniques  have  differential 
effects  on  the  mean  reaction  time. 

The  mean  reaction  times  in  seconds  are  given  in  Appendix  D, 
Table  VIII. 

The  following  data  were  used  to  calculate  the  chi  square 
test  statistic: 

N  =  24    ,   k  =  3  ,  Rj^  (alphan.)  =  68, 

a  =  0.05  ,  df  =  2  ,  R-  (colors)   =  24,  and 

R_  (symbols)  =  52  . 

2 

This  resulted  in  a  value  of  X   =  41.34  with  an  associated 

r 

probability  of  less  than  0.001  which  is  less  than  the 
selected  a-level.   Therefore,  H^  is  rejected  and  differences 
between  the  three  coding  modalities  with  respect  to  reaction 
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times  are  concluded.   Regarding  the  ranksums  of  24,  52,  and 
68,  the  only  actual  conclusion  that  can  be  drawn  is  that  the 
reaction  time  of  the  color  code  technique  is  significantly 
faster  than  the  reaction  time  of  the  alphanumeric  code. 
Therefore,  the  parametric  test  "Analysis  of  Variance"  (ANOVA) 
(Hicks,  1973)  was  applied  to  the  data.   A  comparison  of  the 
Boxplots  (McNeil,  1977}  shown  in  Appendix  F,  Figure  5,  how- 
ever, indicated  the  non-homogeneity  of  the  variances  and 
positive  skewness  of  the  data. 

In  order  to  obtain  homogeneity,  McNeil  (1977)  suggested 
a  series  of  transformations  that  can  be  applied  to  the  raw 
data.   Within  the  root  transformation,  the  fifth  root  turned 
out  to  be  best.   The  resulting  Boxplots  in  Figure  6  of  Appendix 
F  show  that  the  Midspreads,  that  is,  the  spread  from  the 
25th  to  the  75th  quantile,  are  nearly  the  same,  and  that 
most  of  the  positive  skewness  disappeared.   The  transformed 
data  are  attached  in  Appendix  E,  Table  X.   A  summary  table  of 
the  original  and  the  transformed  data  is  given  in  Table  XI  of 
Appendix  E. 

To  test  the  Null  hypothesis, 

H^  :  the  variances  are  the  same,  against  the  alternative 

H,  :  the  variances  are  not  homogeneous, 
Bartlett's  Test  (Brownlee,  1960)  was  conducted. 
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-  .1.  h  i"-7 

The  test  statistic,   TS  = ^ ,  is 

1     ^11 


chi  square  distributed  with  k  -  1  degrees  of  freedom, 
f  is  the  number  of  data  minus  the  number  of  columns, 
f.  is  the  number  of  data  in  column  i  minus  one, 
s."  is  the  variance  of  column  i. 


k  is  the  number  of  columns,  and 

2 
s   is  calculated  by  the  formula 


2      1     ^   ^     2 
s   =  —I Z   f .  s . 

^     i=l   ^   ^ 
E   f.  ^  -^ 

i=l   ^ 


To  calculate  the  test  statistic,  the  following  data 
were  used: 

S^^  =  0.0035     f^  =  87     f  =  319 

S^  =  0.0024     f^    =  117    s^  =  0.0031 

s^^  =  0.0035     fj  =115    df  =  2  . 

2 
This  resulted  in  a  test  statistic  of  X,^')  -    4.38.   The 

corresponding  probability  of  about  0.12  is  more  than  the 

a-level  of  0.05.   H^  is  accepted;  homogeneity  of  the  three 

variances  is  concluded. 

Inspection  of  the  Stemleaf  plots  (McNeill,  1977,  p.  2), 

given  in  Appendix  G,  indicated  that  the  data  of  the  three 

columns  were  normally  distributed. 
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The  summary  of  the  two-way  ANOVA  is  given  in 
Table  V. 

Table  V 
ANOVA  Summary 


Source 

d£ 

SS 

mS 

F 

Code 

2 

0.78 

0.390 

130** 

Subjects 

23 

0.11 

0.005 

1.67* 

Codes  X 
Subjects 

46 

0.22 

0.005 

1.67* 

Error 

250 

0.65 

0.003 

Total 

321 

1.76 

*   P  <  .05 
**  P  <  .01 

The  results  of  the  ANOVA  confirmed  that  there  are 
differences  in  reaction  time  between  the  three  coding  modali- 
ties.  As  the  critical  value  for  2  and  250  degrees  of  freedom 
is  approximately  3  (Hicks,  1973,  tables),  the  obtained  F-ratio 
of  130  indicates  high  significance.   The  F-ratios  for  the 
subjects  and  for  the  interaction  of  subjects  with  codes  are 
also  significant  at  the  0.05  level,  but  much  less  than  the 
ratio  for  the  codes  alone. 

For  the  codes,  the  Newman-Keuls  range  test  (Hicks,  1973, 
p.  35)  was  conducted  to  analyze  between  code  differences.   The 
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standard  error  of  the  mean  for  each  code  was  0.005  for  colors 
and  symbols  and  0.006  for  alphanumerics .   This  resulred  in 
values  for  least  significant  ranges  of  0.0139  and  0.0166  for 
differences  between  adjacent  (ordered)  mean  values  and  0.0166 
and  0.0199  for  every  other  mean  value.   As  all  three  differ- 
ences between  the  means  of  the  codes: 

colors  versus  symbols  0.069 
colors  versus  alphanumerics  0.123 
symbols  versus  alphanumerics  0.054 
exceeded  the  least  significant  ranges,  differences  in 
reaction  time  between  all  three  codes  are  concluded.   That 
is,  the  reaction  time  of  the  color  code  is  shortest,  followed 
by  the  symbol  code,  and  the  reaction  time  for  the  alpha- 
numeric code  is  longest. 
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V.   DISCUSSION  AND  CONCLUSION 

The  data  obtained  from  the  experiment  therefore  suggested 
that  the  color-  and  symbol -codes  are  superior  to  the  alpha- 
numeric code  with  respect  to  the  minimum  number  of  errors 
made,  and  that  with  regard  to  the  reaction  time  the  color 
code  is  superior  to  the  other  codes,  followed  by  the  symbol 
code. 

Although  the  ANOVA  gives  strong  evidence  that  there  are 
differences  between  the  three  coding  modalities,  the  result 
was  to  be  treated  with  caution.   As  the  exposure  time  of  the 
cards  was  exactly  1.5  seconds,  all  reaction  times  exceeding 
this  value  were  lost.   In  case  of  the  colors,  two  reaction 
times  were  truncated  for  the  symbols  four,  and  in  case  of 
alphanumeric  code  32  data  were  truncated.   The  truncation 
of  the  reaction  time  data,  mainly  for  the  alphanumeric 
code,  led  to  an  underestimation  of  the  mean  values.   As, 
however,  with  the  underestimated  mean  value  for  the  reaction 
time  of  the  alphanumeric  code,  ANOVA  suggests  significant 
differences;  it  would  give  an  even  more  significant  difference 
if  all  reaction  time  data  for  the  alphanumeric  code  were  in- 
cluded.  For  this  reason,  the  conclusions  drawn  from  the 
ANOVA  test  are  justified. 

Nevertheless  the  general  statement  that  the  color  code 
is  superior  to  the  other  coding  techniques  under  all  conditions 
cannot  be  made  because  of  the  following  limitations  imposed  on 
the  experiment: 
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1.  Artificial  Environment 

The  experiment  was  carried  out  in  a  controlled 
artificial  environment  that  eliminated  most  sources  of 
environmental  load  imposed  on  the  subject  as  noise,  different 
light  conditions  and  temperature.   Further,  because  of  the 
short  duration  of  the  experiment,  no  significant  additional 
load  because  of  fatigue  effects  could  arise.   And  more 
important,  during  the  experiment  the  subjects  had  only  a 
single  task  (scan  the  cards,  search  for  a  target,  identify 
it,  and  respond)  while  under  operational  conditions,  an 
operator  has  multiple,  complex  tasks  to  perform  which  may 
impose  a  large  workload.   Under  these  conditions,  different 
results  for  the  three  codes  may  be  obtained. 

2.  Selection  of  Subjects 

The  selection  of  subjects  was  not  random.   All 
subjects  were  from  the  Naval  Postgraduate  School  population. 
This  sample  represents  neither  the  whole  population  nor  the 
population  of  pilots.   Therefore,  the  conclusions  are  only 
valid  for  individuals  with  backgrounds  similar  to  those  of 
Naval  Postgraduate  School  military  officers. 

3.  Selection  of  Stimuli 

The  selection  of  stimuli  imposes  another  limitation 
on  the  results  because  the  results  can  only  be  regarded  with 
respect  to  the  three  sets  of  stimuli  used  in  the  experiment. 
Different  sets  of  symbols  and/or  alphanumerics  may  lead  to 
different  reaction  times  and  different  percentages  of  errors. 
The  color  code  in  general  seems  to  have  an  advantage  because 
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some  colors  have  a  conventional  meaning  while  symbols  and 
alphanumerics  do  not.   In  addition,  the  two  alphanumerics 
E  and  F,  used  in  the  experiment,  might  have  increased  the 
load  on  the  subject  because  of  their  similarity.   To  dis- 
criminate between  these  letters  probably  two  fixations  were 
necessary  which  might  have  caused  longer  reaction  times  and 
more  errors.   Also,  the  letter  F  could  have  been  erroneously 
interpreted  as  foe.   Further,  the  experiment  emphasized  the 
search  task  because  the  finding  of  the  target  included 
probably  at  least  for  the  color  code  the  identification  of 
the  target.   Therefore,  the  results  concerning  the  reaction 
time  were  not  surprising  as  it  is  known  that  the  color  code 
has  the  shortest  search  time. 

Even  if  repeated  experiments  with  different  sets  of 
stimuli  and  different  subjects  under  more  load  confirm  the 
results  obtained  from  this  experiment,  there  are  some 
factors  that  have  to  be  regarded  before  colored  CRTs  can  be 
utilized  in  the  cockpit  of  aircraft: 

a.  Training. 

The  advantage  of  colors  versus  symbols  in 
reaction  time  might  be  overcome  by  training.   Research  should 
be  done  in  this  area  and  the  cost  of  additional  training 
compared  with  the  cost  of  a  color  display. 

b.  Number  of  Dimensions  that  Can  Be  Coded  with  Color 
As  the  number  of  colors  was  limited  to  four, 

only  four  dimensions  could  be  coded  with  colors.   Coding  of 
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more  dimensions  with  colors  will  lead  to  performance 
degradation.   Another  coding  modality  (e.g.,  colored  symbols) 
should  be  used  for  this  case,  thus  utilizing  the  principle 
of  redundant  coding. 

3 .  Ambient  Illumination 

Brightness  and  contrast  of  displayed  information  in 
relation  to  ambient  illumination  is  an  important  factor  for 
display  systems.   With  conventional  color  CRT  displays,  the 
brightness  of  the  spectral  colors  is  lower  than  can  be 
obtained  with  a  black  and  white  CRT.   Therefore,  the  colored 
system  must  normally  be  operated  in  lower  ambient  illumina- 
tion.  Infalling  sunlight  in  the  cockpit  during  daytime  is, 
however,  very  high  ambient  illumination  and  can  cause  colors 
to  wash  out  and  to  reduce  saturation. 

4.  Peripheral  Color  Vision 

Color  cannot  be  sensed  in  the  peripheral  area  of  the 
retina  and  vision  becomes  dichromatic  at  approximately  60 
degrees  from  the  fovea  (Krebs ,  1978).   This  zone  varies  from 
individual  to  individual.   The  lack  of  color  vision  in  the 
periphery  sets  constraints  on  the  location  of  the  colored 
display. 

5.  Color  Vision  Defects 

There  are  several  types  of  color  vision  defects,  but 
these  defects  should  not  influence  the  decision  whether  to 
use  a  color  display  because  only  eight  percent  of  the  healthy 
male  population  (female  0.41)  have  some  kind  of  color  defects 
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These  individuals  are  excluded  from  most  military  jobs  by 
screening.   However,  before  extending  the  use  of  colored 
displays  for  other  types  of  jobs,  these  personnel  have  to 
be  screened,  and  the  number  of  operators  will  be  restricted. 
Perhaps  some  operators  that  perform  well  on  monochromatic 
systems  will  be  eliminated  from  their  jobs. 
6.   Cost,  Reliability,  Readiness 

Not  only  the  procurement  cost  for  a  colored  CRT  is 
higher  than  for  a  black  and  white  CRT  (about  20-6)  ;  also  the 
maintenance  cost  will  be  increased  due  to  more  sophisticated 
maintenance  equipment  and  better  trained  maintenance  personnel 
Further,  a  shorter  lifetime  and  shorter  maintenance  intervals 
can  be  expected  in  combination  with  longer  maintenance  time. 
This  leads  consequently  to  a  reduction  in  the  availability 
of  the  aircraft  and  therefore  to  a  decrease  in  their 
readiness . 

Although  most  people  like  colored  displays,  the 
above  factors  have  to  be  considered  before  selecting  a  colored 
display.   A  cost-benefit  analysis  should  be  performed. 


42 


APPENDIX  A 
INSTRUCTIONS  FOR  CODING  EXPERIMENT 

I .   Objectives  of  the  Experiment 

The  objective  of  this  experiment  is  to  find  out  whether 
there  are  differences  between  several  coding  modalities  with 
respect  to  reaction  time  and  the  number  of  errors  made. 

An  application  might  be  the  coding  of  a  tactical  display- 
on  board  airplanes. 

The  coding  modalities  used  in  the  experiment  are: 

-  alphanumerics , 

-  colors,  and 

-  symbols. 

Today's  state-of-the-art  in  electronic  engineering  allows 
all  three  coding  modalities  at  different  costs. 

II.   General  Instructions 


Each  subject  is  shown  three  sets  of  cards  with  either 
alphanumerics,  colors,  or  symbols  by  means  of  a  Tachistoscope 
with  automatic,  computerized  cardchanger. 

The  following  table  shows  the  codes  used  together  with 
their  possible  meaning: 


Color 

Symbol 

Alphanum. 

Possible  Meaning 

Red  Dot 

A 

E 

Enemy,  Danger 

Yellow  Dot 

D 

U 

Unknown,  Unidentified 

Green  Dot 

+ 

F 

Friendly  Forces 

Blue  Dot 

0 

N 

Neutral  Forces/contacts 
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Subjects  have  to  search  the  cards  and  determine  whether 
or  not  they  show  a  red  dot,  a  triangle,  or  an  E,  respectively, 
and  respond  to  those,  and  only  to  those,  cards  by  pressing  a 
button  placed  under  the  Tachistoscope  as  fast  as  possible. 
Superimposed  on  the  cards  is  a  "noise"  card  to  complicate 
the  task.   The  number  of  errors  will  be  counted,  and  the 
reaction  time  will  be  measured. 

The  next  figures  represent  samples  of  the  three  sets 
of  cards.   Note  that  they  show  an  E ,  a  red  dot,  or  a  triangle. 
Subjects  have  to  respond  to  those  cards  while  they  are 
presented;  a  later  response  will  be  counted  as  an  error. 
Upon  a  correct  response  a  new  card  will  be  presented 
immediately.   Otherwise  the  card  stays  in  the  viewing  field 
for  1.5  seconds. 

Ill .   Procedure 

A.   Determination  of  the  Sequence 

The  Random  Number  Generator  of  the  hand-held  calcu- 
lator TI  59  (PGM  2  of  applied  statistics  module)  will  be  used 
to  generate  random  numbers  drawn  from  the  uniform  distribu- 
tion between  1  and  6.   These  random  numbers  determine  the 
sequence  in  which  the  codes  will  be  presented. 

1  means  alphanumerics  -  colors  -  symbols 

2  means  alphanumerics  -  symbols  -  colors 

3  means  colors  -  alphanumerics  -  symbols 

4  means  colors  -  symbols  -  alphanumerics 

5  means  symbols  -  alphanumerics  -  colors 

6  means  symbols  -  colors  -  alphanumerics. 
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y  =  yellow  dot 
g  =  green  dot 
b  =  blue  dot 
r  =  red  dot 
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B.  Warm-up  Phase 

After  the  subjects  are  seated  in  the  booth,  and  the 
deck  of  cards  is  placed  in  the  card  changer  by  the  experi- 
menter, the  door  will  be  closed  and  after  10  seconds  the 
first  10  cards  will  be  shown  to  the  subjects  in  the  viewing 
field  of  the  Tachistoscope  at  a  rate  of  one  card  per  1.5 
seconds.   On  identification  of  an  E,  a  red  dot,  or  a 
triangle,  the  button  under  the  Tachistoscope  has  to  be 
pressed. 

This  will  be  repeated  for  the  remaining  two  sets  of 
cards.   The  probability  of  getting  a  card  that  requires  a 
response  is  0.5. 

C.  Hot  Runs 

After  completion  of  the  warm-up  phase,  sets  of  40 
cards  will  be  placed  in  the  card  changer.   The  procedure, 
the  sequence  of  the  codes  and  the  presentation  rate  will  be 
the  same.   The  probability  of  getting  a  card  that  requires  a 
response,  however,  will  be  much  lower.   These  cards  are 
randomly  distributed  within  the  deck  of  cards. 

IV.   Please  do  not  smoke  while  performing  the  experiment. 
V.   Thank  you  for  participating  in  the  experiment. 
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APPENDIX  B 
BASIC  PROGRAM 

10  REM  -   THIS  PREAMBLE  MUST  PRECEDE  ALL  PROGRAMS 

20  REM  -   USING  THE  LAB8/E  'SPECIAL  FUNCTIONS'. 

30  UDEF  INI(N) ,PLY(Y) ,DLY(N) , DISCS, E,N,X) 

40  UDEF  SAM(C,N,P,T) ,CLK(R,0,S) ,CLW(N) ,ADC(N) 

50  UDEF  GETCM,L) ,PUT(M,L) ,DRI(N} ,DRO(M,N) 

90  DIM  A(IOO) 

91  PRINT"NUMBER  OF  CARDS" 

92  INPUT  Nl 

93  PRINT  "ENTER  VIEWING  TIME  IN  1/100  OF  A  SECOND" 

94  INPUT  N2 

95  E0=0\E1=0\E2=0 

100  REM  **********INITIALIZE  FOR  SET  OF  50  CARDS  ************ 

10  5  PRINT  "ENTER  SUBJECT'S  NUMBER" 

106  INPUT  SI 

120  FOR  1=1  TO  Nl 

122  A(I)=0 

123  NEXT  I 

125  PRINT  "ENTER  TARGET  CARDS  EACH  tf  FOLLOWED  BY  <RET>" 

126  FOR  1=1  TO  5 

127  INPUT  N 

128  A(N)=1 
135  NEXT  I 

140  E0  =  0  \E1  =  0\  E2  =  0 

200  REM  ************    RELEASE  CARDS    ********************** 

202  Z=CLK(2, 500,0) 

204  Z=CLW(0) 

210  FOR  1=1  TO  Nl 

220  Z=DRI(0)\J=0 

230  Z=DRO(1,0) 

231  Z=CLK(2,23,0)  \  Z=CLW(0) 

232  Z  =  DRO(0,0)  \  Z  =  CLK(2 , 100 , 0)  \  Z  =  CLW(0) 
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235 
240 
245 
250 
255 
260 
265 
270 
275 
280 
300 
305 
320 
325 
330 
370 
380 
399 
420 
425 
430 
440 
450 
499 
510 
512 
513 
514 
516 
518 
520 
530 
540 
545 
555 
560 


**************** 


Z=CLK(2,1,0) 

Z=CLW(0) 

Z=DRI(0) 

J=J+1 

IF  Zoo  GO  TO  300 

REM   *********N0  RESPONSE  YET 

IF  J<N2  GO  TO  235 

REM   ********   NO  RESPONSE  AFTER  N2  CARDS   ************ 

IF  A(I)=0  GO  TO  399  \  REM  CORRECT  RESPONSE 

IF  A(I)=1  GO  TO  399  \  REM  OMISSION  ERROR 

IF  A(I)=0  GO  TO  370  \  REM  COMMISSION  ERROR 

IF  A(I)=1  GO  TO  320  \  REM  TARGET  DETECTED 

REM  ***************   COLLECT  RESULT   *************** 

A(I)=J 

GO  TO  399 

A(I)=2 

R1=N2-J  \  Z=CLK(2,R1,0)  \  Z=CLW(0) 

NEXT  I 

FOR  1=1  TO  Nl 

IF  A(I)>0  GO  TO  430\EO=EO+1\GO  TO  499 

IF  A(I)>1  GO  TO  440\E1=E1+1\GO  TO  499 

IF  A(I)>2  GO  TO  450\E2=E2+1\GO  TO  499 

E0=E0+1 

NEXT  I 

PRINT  "RESULTS  -  SUBJECT  NUMBER"; SI 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

FOR  1=1  TO  Nl 

IF  A(I)<3  GO  TO  570 


NUMBER  OF  CARDS  =  ";N1 
CORRECT  RESPONSES  =";E0 
COMMISSION  ERRORS  =";E2 
OMISSION  ERRORS  =";E1 

RESPONSE  TIMES  FOR  DETECTED  TARGETS" 
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565  PRINT  TAB(20) ;A(I) 

570  NEXT  I 

580  PRINT  "IF  ANOTHER  RUN  FOR  THIS  SUBJECT  TYPE  1  ELSE  TYPE  2" 

590  INPUT  K 

600  IF  K=l  GO  TO  91 

670  PRINT  "IF  ANOTHER  SUBJECT  IS  WAITING  TYPE  1  ELSE  TYPE  2" 

675  INPUT  K 

680  IF  K=l  GO  TO  91 

690  PRINT 

700  PRINT  "END" 

998  STOP 

999  END 


READY 
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APPENDIX  C 
PERCENTAGE  OF  ERRORS 


Table  VI 
Percentage  of  Errors  Due  to  Errors  of  Omission 


Codes 

Subjects 

Alphan. 

Colors 

Symbols 

1 

5 

0 

0 

2 

5 

0 

0 

3 

10 

0 

0 

4 

0 

0 

2.5 

5 

0 

0 

0 

6 

2.5 

0 

0 

7 

0 

0 

0 

8 

10 

0 

0 

9 

7.5 

0 

0 

10 

2.5 

0 

0 

11 

2.5 

2.5 

0 

12 

0 

0 

0 

13 

2.5 

0 

0 

14 

0 

0 

0 

15 

10 

0 

0 

16 

2.5 

2.5 

2.5 

17 

2.5 

0 

0 

18 

0 

0 

0 

19 

2.5 

0 

0 

20 

5 

0 

0 

21 

2.5 

0 

0 

22 

0 

0 

0 

23 

2.5 

0 

2.5 

24 

5 

0 

2.5 

X 

3.33 

0.21 

0.42 

a 

3.27 

0.71 

0.95 
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Table  VII 
Percentage  of  Errors  Due  to  Errors  of  Commission 


Codes 

Subjects 

Alphan. 

Colors 

Symbols 

1 

0 

0 

0 

2 

0 

0 

0 

3 

2.5 

0 

0 

4 

2.5 

0 

0 

5 

0 

0 

0 

6 

0 

0 

0 

7 

0 

0 

0 

8 

2.5 

0 

0 

9 

7.5 

0 

0 

10 

2.5 

0 

0 

11 

0 

2. 

5 

0 

12 

0 

0 

0 

13 

0 

0 

0 

14 

0 

0 

0 

15 

7.5 

0 

0 

16 

2.5 

2. 

5 

0 

17 

2.5 

0 

0 

18 

0 

0 

0 

19 

2.5 

0 

0 

20 

2.5 

0 

0 

21 

0 

0 

0 

22 

0 

0 

0 

23 

5 

0 

2.5 

24 

2.5 

0 

0 

X 

1.77 

0. 

21 

0.10 

a 

2.27 

0. 

71 

0.51 
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APPENDIX  D 

Table  VIII 
Mean  Reaction  Time  (in  Seconds) 


Codes 

Subjects 

Alphan. 

Colors 

Symbols 

1 

0.86 

0.64 

0.76 

2 

0.98 

0.47 

0.69 

3 

1.39 

0.45 

0.67 

4 

1.08 

0.38 

0.52 

5 

0.65 

0.33 

0.91 

6 

1.07 

0.42 

0.72 

7 

0.89 

0.40 

0.84 

8 

0.82 

0.57 

0.65 

9 

0.55 

0.34 

0.72 

10 

1.10 

0.63 

0.67 

11 

0.81 

0.46 

0.63 

12 

0.91 

0.44 

0.76 

13 

0.92 

0.34 

0.62 

14 

1.07 

0.49 

0.70 

15 

0.60 

0.57 

0.75 

16 

0.72 

0.40 

0.82 

17 

0.72 

0.47 

0.57 

18 

0.75 

0.47 

0.54 

19 

0.82 

0.37 

0.52 

20 

1.02 

0.37 

0.47 

21 

0.74 

0.49 

0.57 

22 

0.91 

0.31 

0.51 

23 

0.72 

0.38 

0.57 

24 

1.03 

0.43 

0.73 

X 

0.88 

0.44 

0.66 

a 

0.19 

0.09 

0.11 
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APPENDIX  F 


Figure  5 

Boxplots  o£  Reaction  Time  Data 
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Figure  6 

Boxplots  of  Transformed 
Reaction  Time  Data 
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APPENDIX  G 
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Figure  7 

Stemleaf  Plot  of  Trans- 
Formed  Reaction  Time  Data 
of  Alphanumeric  Code 
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Figure  8 

Steamleaf  Plot  of  Trans- 
formed Reaction  Time  Data 
of  Color  Code 
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Figure  9 

Stemleaf  Plot  of  Trans- 
formed Reaction  Time  Data 
of  Symbol  Code 
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APPENDIX  H 
APL  -  Functions  for  Boxplots  and  Stemleafs 
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